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ABSTRACT : 

PROBLEM TO BE SOLVED: To automatically classify images into sets 
of similar 

shots without finely dividing the image for the unit of a shot and 
without 

damaging time order property. 

y - ■ 

SOLUTION: First of all, the feature amounts of respective shots 

are 

calculated and the shot is used as the block in an initial state 
(step 111) . 

The degree of similarity between adjacent blocks is calculated (step 
112) , the 

adjacent block or step showing the maximum degree of similarity among 

the 

calculated degrees of similarity is merged with one block (step 113) 
and the 

feature amount of the merged block is calculated (step 114) . The 
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steps 112-114 

are repeated until the classification is sufficiently performed, and 
the number 

of blocks is gradually decreased.. 
COPYRIGHT: (C)1997,JPO 
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1 

mAM-iHTm. mws.M.taxmsa/y'o -y 9 w^xg 
•km.Lxmi-fh:Lt\,zi.'^. m^i\fim.<m!Sk 
■/a -y 9 i:nmmyo y9jmm> 

fzmmyo •y9<r>\ mxh s a -y h i.zj^mi-hxm 

i-isti. 1 izismmmru 'y9mii&. 
imm3] ^•/a'y9ff)mimK myn-y9iz 

hh\mziii;>(om^^h^A-h^£^mm^mtii ixm 
t:hxv9'yM.X'h'o . '^myoy^izifttihyu- 
AlS3&*2J.:U:0«-^Wi, ^m:fvy9iz^tiihyu 
-M.(D±\zXh9'yMZ-:>\,^X<0hxh9'yJ^mmmm 

mn-^xnr.z^^hyyj^tixmh^iii. mmm 
1 ttM 2 i,z§smmmy^o .y 9imnm. 

t X h9'yj^^mkmzm-^\,^x^i^i^ 
tit. mm3i,zwstm^yoy9^mm. 
im^ms] yo-y9m-^xmzmhmtty^ 
'y9m-^izmi. mmmi-ty\jy9<r>\ixh9^ 
MzMtxt XV 9'yM.^mmx.i:n\\ mn<7)m^ 
'^i^tifz\zxh9'yj^^m^mrx3y9mma.t^ 

tmy^'y9iz^mthvmyo'y 9^w^mn'h-> 

X. 

mm'~9nyi^ vt^^y u-m.<7)t- 9 sr^aj l . 
get, 

ti^a •yhmiW-m^t. 

1 ifcJiffiStc^^- 3 y h t-^^^^ll. ro -y t« L , 

ya ■y9izm-tmimmmLxm^i-tyx:i y 
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tZtizX -iXm^cOi^ 3 -y hX-m^^tit yn y9i: 

mi, mmmiiibyoy9m^t^mim 

ti-y9mmm. 

[11^7] yu-Amm&x/yx3y9<rMmifi 

^1x-^ii}ixh9'yi>X»h^ix, -y hrttc^i' 
-J>.mLM.(Dhxh9'yJ^lkmm^niii-thltX'^i^ 

3 y hmmAmta^ti. mttyov9<r>iiXh 
m^ix, m.mwm&xmmmmm<, m-tty 

n y ^'Ofif^tl^XTl^l^Sf-ri.T'o •y9<7)hXh9- 

yj^iznLx^xh9'yj^mmfmi^\>^^m<7mM 

mtlfztXhyyJ:^i:»^myx:i'y9(7)mmb-t 

t, mmeizmi<^miSiyu-y9i^m, 

[000 1] 

izmu mz, ^mi:mm-immT-9mmLx 
20 yx:>y9i?i^-ymizim^i-tijmx/mmizm 

[00021 

^cr)n^^mtz)f^\.z\i^ ^mmimz-kx^ 

^t^mmhhb^x.hb. n.m^mmh^m%.T- 
9mtKfSizm-r}\\x^ix^ti'9tmtix\^ix\i. b* 

mb^i, mmzm:fhmmm^j:mmmiWi.\i!,h. m 
~cr)m.^zmti>m&^m^^t3it:ibi,zi.^x. 
m.zmLxmski:mi<r)yQ -y 9 ^z^mh ^ b iw^ 
■th. n-ffyiimzmtwmmimaihzb'.zm^ 

•tmf. miSk<rym.^ bh\^o:ibi}^X'tl. 
[ 0 0 0 3 ] r^u-Aj ^ rf..( 

i^m:mmmzm.^fit. zmmmmf.z\.i. a- 

[0004] r^v-Aj Bijt.^^a»-f|,i:^£7)7 
^y-^9i \i, y\^-J^<m^X'h':>xn-:^^yX'WL 

mtimmi<.zmfj:mmii^n^tmx'M . c 

tliZM. mBm<ntl)^yff)ity ( ON) (OF 

F)ifm.^tih> 

[0 00 5] Tv-gy hj {i. x^:7i:ll«lC|S|->&^ 
50 mKJ(CT-^:70+A»^>SlXtfi§iiit^«!«Eig?:»'H\ r 
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[0 0 0 6] -H. fi^-yj t(i. ii*«f^tfcv^ 

L, ^i^t^j:i!m^ii'>x\.^h\.^^\,zm.^tih, m lo. 

[0007] KLhiO^ft^pit-f i^-ytOgtffiW^Sr^J 
V— yc. 3Ki©i/-yc. ••■kv^3J:3(2, -e^L-fix^ 

<wm<^i^-yti^^^i,zm^^x^^it?f-^j:'f. 

[0008] aSM^r^HiS:^T3(c(±x H-U^rk'*f 
Sr#J!t=5r{tntf^^>^v>3&<. m^T(iZ<r>imiiA^iz 

X. mm'f-fco^izmL. ^A,t^i)^cosmiU}^^if) 40 
[0009] mLtimm<7)^mmizm-:s^^—ft^ 

[00 1 0] mtf, mm-imiSi7i'-j^<7)7i—M, 
m,-r^ y u-Aizmh^immn ixmmm 7 
mmfih,tih. Ltiiii^3^vVi$.^(7yftmmtLx 
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[0011] x-y#fifc7)^a^ BWt tfzmt LX 
ti. (l)Pl-£0i^-y{i<El;tfefflfS*^'^^:Si:V^3i« 

m^±.x'9yx^^)yyL. mm^m^o ^mm 
mmnmi (#ra¥6 - 2 5 1 1 4 7-f-) (2)- 
mzmm&x\,zi5\^x\m^t t ii^zmkr—s^im^ 
•fh^mx-htmmif'^B 7 h*<aT'^< v-y*fi 

LT. c:<0#tW6tcJ:-5Ti^-y^tM-5S-rs r^lPg^ 
fflofch'T^jf • y^-^i^'y^^ • 'f y^7x-;^j (t'u 

b'>-'3y^^fe^g$g$, Vol.19, No. 7, 1995/12)-^, 

tOS:^L^VWy:5'7x-;?.S-f^fiKL. ^mWt^i 
— ric*t L TSiR t /vTftaBffl^ S c: k <fc -5 T 
l!*^i&7'D7^'(C^J-{t'& r Content-based Browsing of 
Video Sequencesj (ACM, Multimedia 94, P. 97-) W 

[00121 

[^BMj»^LJ:3-ri.illS] m^<r)n^^i:m 

tLx. nm'mti'^^zi.i. m~mm:fh^u 
'vC't^j:h%i^-y!i^mz^m^tih zttmt 
10 013} ±MLf:iWknm(Do*>, ^vmA-^h 
immirmj Ji, m^^zm^:^yh^(omtiiimb 

i^3-yhmX'(r>^mi:'^mizLX\>^?>, u»u. 

mui2mm<7mmmi-mizwi.'^izhR^i^3 7 h 
m<7)tzi6uijm^t^ix^-^'x Ltdt\>^o mm.^^± 

th. LfziPr.X. iya yhm&X'ii^j:<i^-ymmz 

[0014]-*. ^^m-yhAmmiimjm^^t: 
m<7)mmii, i^a-yhmco-^mvim^^t^ivt 
^i>^mm-^<. x'owm^j:mi.z^mi:m^ 
bimbitzh<7)X'h^. z<^)i-h, rmmmsm 
nmjTii, ^-<r>i^-yimmuc:mmizx-oxm 
^^tix^^hb^^mmzm^^. &mim-^<mL 
^m^m Lx , mi&.tfz^cmi^'^hiti: t ob^co 
^m^n-^x^^i. zcT) ^vkimwrnmiomi a. ±a 
(ommu^ (^fr 1 ) iWzLx^^hiK \mmiz 
TmThhb\>^o^mm!n^ (^2) i^^Lx 
v^^v^. itzi}<-yx. zmmzxiiii. mmmist 
mmtaix, i^mzr-^x't>-omuitmm 1 

':><7)yn-/^'bLXmiiibXLtoZbi/^hh. t^h 

}:M<D-:i.-x^mi.is^<mim^^xmmtiki. 
^mi^zyfwmx 9 =jirx'<^v^^t: ^ii^hma^in 
-yb\.xm:^hzbts:<. --xmrn^fz^'ov^ 
bM£LX\.to,^'^. z.<r(mx:\t. ^Wi^m. 

ts:i^-y^%'m.zmA-t^Z. btfiX'^^j:\.\ 
[0015] '■#^iS$rfflV^/ih'T:t-7'7'^>'*y^- 
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tcn-i^-yfzm^th Z t iS^T^ . ±j*<Ol^lBIW)liK 

^i\Wzi-jm^'€o Z b ti^X'^ h . LA- L=5:*-' (> . 
J/ - y ^ ^ *i o T |S| t B G M L T V ^ S 

10 0 16] Content-based Browsing of Video Sequ 
encesj TW. ^ftbv-a -y h#ffiK^HS$-ffV\ xg -y 

10 0 17] 'immmm^mi&.z'^x.h i o 

[0018] *l6BB<0@W«s m^ii^ 3 -y VmizB 
<. a(KLJti^3 •yh<om^tCBi(!mSr:«-S-r-l.^t. 

[00 19] 

[0020] ^ts:hhwm<r)m.-:^^ v 9%mm 
9\zfsWcfhm^-fu^y9^Wi''d^x'h'>x. 40 

<r>^'av9\,z'm'^t\:tzm:i:K-))-fhmkK-hlM 

b. i^-xr3-,9cmm'—9m^t>'m.yuv9<nw^ 

m.^%mh^WM.'i^1Mb. imM.\,zmri\.^xmi 
ra-y9^:l ocOT'D y 9 (cff^-rST'n -y 

•y^'fif^xs^RaLTH^T-rscittcj:*). am^ti 
[0021] if.wn<^mk-fu -v ^'hmjim^ziix^x . 50 
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9<r>imx'h^->3-y hiz^mtixmi:^t-txi,x 

v^. ttz. ^:ray9ff)mAblXii. 'mc^'o v^ 

i}>$>l\<^iiZix^(om^'^h-ti^(i>^j:hmimtiitX 
Wz\^Xhi/'yJ>.^m^^tZbifimL<. Zffyi^. 

yo-y^iz-ttixlyu-Am*^2l;)±cr,^'tizii. i 
ig7"o -y^liZ-^tiilti^my U-Jxco^tx vyyuz 
r>\^X<n\.7.Y^'ymm^^%^'^'^XWzyzXY9 
7i*i£:#ffi*ftSC:fc3&«»iLv\ t.fz. mmt. 

BSStl. r O -y ^ CO t X h /7 A t X h A 

^ ^ef^lSfc:fcftSBfS^I.:?'o -y ^'^flf^fclg 

/^ixSr^^moyo y9<n'm.ss.bthzbm'i l 

[0022] *l|B3t7)B!)5«yn -y ^'^^SJi. H^r 

hmcfu'/^'jfmmrch'^x. x-h^Ktzmwr- 

m^m--thw^ir-nw^')b. w^n'-m^ 

t^i^a-yhmm-^m^b. yu-Anwts.izm-^\'^x 

#i^3 -y hcomMSr»aj-r^i^ 3 -y hmftSttiiSS 
lt^»4«»«^>'3-yb'CWBlt$ix57'n-y^'{wM 

L, yo-y^izm-hmAmmLxmii-hyo'y 
mmm-intat. %tii^tirzmm.<r)'i'X'WcK(D 
mmiiiF uzm^-t^yo y^n owro y 
^•t^zbi,zX':>xmfi^<^>'3 -y hx-m^^myti-y 
9^^L, m{m<7)ntiibra'-j9m-^bi^L 
mtmm.mm&vm^m'mmb, i^ti. 

[0023] *f6B^oW«:rn -y 9^^W.X'li. y W 
-A^1S»at^:ro -y 9mwm.i:hxh^yJ^X'mh 
i^3-yhrtC7V-ix!mS*cObXh/7Atfea 

tc«-:Jv ^-csiOKSrff iu L . mm.mmRtmm.mm 
mMifi. mntt^y^'y9com^i,zmtx^mmti> 

yay9cr)t.x}-yyMzntXh:^h9'yM.Mimm 

9.^n\'mnmm%htifztx vy^M^^m^^my 

n-y2?c7)«<aJii:-ri>J:atc1-SC:fc*<. ff^Lv^. 
[0024]!^^. *f6BB«li*ffiyn -y ^'*5S:frffiat^ 

iii-^tzm^mmyri'y^^:. mM<n>n\^hffit^ 
tim^-i-hb\^omL^m.Lx\.^h. ^(^tzib. im 

mutfzmiSLnm^x'i-ommmizmm^j:miSiyx:i 
■y9cr>mm^x'ihi, tfz. m^tifzv^iSiya y 
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[0025] 

[0026] zcTimmmmxii. g -y h*ia^ t'-c 

m.<r)'/uyi^\izm\^titzvm.<zr>\^X. ^fu-y9 
^^46. \ixvyyMzmr}%^mi^kzW^h2:ro 

mhixtM [z{,b<r)mkts^i^-yi<z^mixh . 

[00 27] \iXV^yMt. mUi. M^T-^ti-^ 

\'(^^'^m.ti:>f:<r>'&W7t^^m^^Lxwzwmm. 
yuzm^^<n^'jt(rm.<r>m^m^^. 

<7)«/jNttSrM'<.T hX h^7i>.2:^-ri>.I i: oT 

m^n^<DrV'y ^OtX h^^ASr^^^fc L-ctx H 
^7Af&a«0«»S:tf -5T t X h^^7 AS:^i«^S C: t 
fcrj;"?, #^f^7'n-/^'Ohxh^^7ASr^Sii:*« 

fi=-5T#^hxb^^9AO®«. •r!5rfc*>f*iEt«.bx 

[ 0 0 2 8 ] 0 1 ti, *l%Ha<7)||i£(7)-jgffiWBj^»yp 
•y ;?ii-«^ao1f ^$:^-ryo -y :7llt-J)S . 

7u';9^mm.ii. x-nm^r-miQii^-yiiz 
i'-yf,z:^mtifzmii etLxmk^-y 

^gpi 7tc^-fl.t«0-e$>'). :x—f^>'^y:c- 
XSS 1 8 A:'J-ri.i-if*^A>«g^l3 J: ^ r > 

mx'%hi.oi,z'^£'>x\'^h, 
[ 0 0.2 9 1 A*B®T-^?j 1 0 izmm^<r>-^y 

r;n— b . atfl<7)T- 7 * y h , H^-t^ Xli 
eST'S)^. Mxtf, A::']BifeT-:5'?i|l 0{i. NTS 

cwm^WA^-^ 3 0 7 p-A/fjfc^yru Lti 
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-vx'^>r')yyi,ti{i<r)X'h'^xiiii^^. ttz. a 
:»ja®r-^^JlO(i. NTSC<0j:^^:TtD:5^fi# 

^i:>f>l:«A:>]$ilST-:?T'J>-5T t A- Hr ^ X 

j?>c D - Rommc^wmm.\,zm^^fix v ^sh«7 

T-^'?iJ 1 OJit + 1 tS:«7)7ix-A 1 0. 1 1 ,-. I tt1«' 

N T scvmrn^x-hh, 

10 [0 0 30] A^JB«t-:}'5>I1 01:7V- A#fiT« 
SH-'S.BmT-:?^]^* U 1 lA<S^t^>^^TV^S. Bffi 

T-^'?ij^ ^ y 1 1 ti. m^tcA^iBfiiT-^'^ij^ isift 

LXii<ti»Xti:<. hhnSLtxmx^1Xt:T-9t: 

m^h^<n>mMhtih'm^j:ii^:^ m^zimLx 
[0031] BffiT-^'?ij^t'j 1 i*>f>B?;^^ai$it/c 

20 A:']B«T-^5lj3!)«A*-rS V 3 >y hmfita-aSt 125." 

2 a. i^3 -y hs^mmm^miLx. #7 

w-Aio. ii,-, it(?)T-^'k:S-:J#A:')®«T-^' 

Srn+m {tzi-zLn<t) <7)x3-yhSo, Ii,--,Sn 

fi-^tc^J6«Jn;?ilS a -y hffllBSrf ijffl t>«i?^ 
V^L. Iil#<^;&-y VMmimi:mmLXi^3 >y htc^J- 
«LTt«i?=5rV\ tfo, K^ifiW^B-zHz^L 
TfcV^TtiV^, *IIJfeOJ^«|-Ci±, Bif1?cO;&-yhjii«| 
30 ajl$Wfcj:-5Ti^3 -/ hmfit^J-IS-r?.. ^:t5. Si^-t 

hihh\mmL<r)yv-j^'mm-hi><ni-w^i.z 

ix7'o/^coi«rj)l>. 

[0032] mmm^u 1 3 a. #7 \>-j>.m^ 

40 ::T'{±, BtR7l'-AIo, Ii,-.It«J!)^TSr'?-ix-eix 
RGBffl?gt^U RGBhXh^^J^tLXyU- 
Ai^SilHo . Hi,-. Hi Srtii^] LT . 
[ 0 0 3 3 1 LT. >- g >y h#a*«[JlJgS 1 4A^m 

hit. 3 -y h^samajgs 1 4 ji. ^-3 y hmmm 

a 1 2t'^Mi$^I5t>- 3 -y h So . Si S„£7)ff?gi:B 
mffifSISSiSPl 3t:i#<^ii;t7U-AmiHo.Hi. 
-.Httt^S-CJfV^T. i/g-y hSo.Si.-.SnCrfct^ 
iO>'3 -y h-rt<0^7L'-AOtXh7'7A|&aS5:Jafl: 
LT=g-v3 7 hri:cr)#at1-^ri5*>i^3 v H^^SftS 
50 Ho.SHi,-,SH„$r»ai-ri.. MOi^tlfZi^a -/ h<l^ 
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sfctsHo.sHi.-.sHnJi. mm.wmmm^^m 

Ho.SHi,-, SHn-^. X3 yVtrm^Lfzyn-yifO) 

■rstoTis. mmmmmmmmxmm 5 10 

a. •/a'y^^j:\,^l,'>3yh<r>m^l,zi.-oXmz^j:r^ 

u-y?<7^m.&{\Lxvif=yj^) ^»tii-r§, %mz 

mmn\^t\^mm:m.LxmiL. i^-ynz^^ 
^tifzmm eimki^-ymni i^z^-^-th, tc 
fc, jL-if{i, imi^-y^uiii<zwh^tihi^- 

y{z^m^ixt:W& 1 6 {c*f L . fifH^ifilt i 0 SifBC 20 

msi}'t^Xi)-th:ittizi.'>x. ^<nw^^m.mzK 

m^^h:Lbmmx'hh, 

[00 34] i^3'yhmmmm2. mmimmm 

13. i^3-y vmmm.\m i AmmmMmmm 

y7^'>xTtJ:-:>•C^PI2•|eSLTt)J:V^L. mL<^ 
C P U t V7 h'>xrc7)«i;9.^i5-ti-{c i oT^JSLT t 
m^t, -^$:»ffl£7)^N-h''>xr{CJ:o-Cll3SLTi) 
m^L. ^S:l|tfflcO>'N-H'?xT^ffll»^T5eSLTt> 30 

[ 0 0 3 5 ] >/ hm*co»aitcov^T. m 

~2>.<r>'f—^ij'iz>^f—? (RGBt-:?) COXM^n 
htl (Xr-'/Tl 0 1). 7U-Ari:C7U-A!^ 
J|cOhXh^^AHo.Hi.-,Ht*«4^L (X-f-yn 
0 2 ) , X 3 -y hmLMMtaU 1 4 lCA:^J-tl. . 
-etL-P^liOS^a 7 hSo.Si.-.SnlCJit'CO^U-Aj&s 
®-ri.*H7)fflfgt. i/'3-yh#ffi5Miai2*»f?,j^3»/ 40 
hmLMMta^l 4izXi}LX\^?>. ^ZT'>3 y h# 
SaSCajSKl 4«i, j^3 -y h So, Si .-. SnrttC-ecT) 

\.XY^vhmmkn^\. (Xr-yn 03) . bX 
hy7-M^a«<7)jg»t1f ^ixfctX hi^^i^Srx 3 -y 
bri:iC-?-c7)v'3 -yhiRfSaSHo.SHi,-, SHntt 
X^-n^h (Xr-yn 04) . 

(oo363::c:t, bxh yvh.wm(m%<r>mm 
\,zo\^x^\ii?.mzmmh, muzi.o\z\LXYyy 
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^z^m^fih^,<n>X'hh. 

[00371 t-ts H_l. H_2. H_3, ■•■$-#tX 
hT'^AtL, H_l(j), H.2{j), H_3(j).-Sr 
fiK^jtCfe(tS=&tXh/7AH_l. H_2. H_3. 

(j)i:tl.. 

[ 0 0 3 8 ] #hX h^^Atf)^^ j 3&«0*>^>milT# 
h^^7A*JlA»(i>k^-C#^tri>t#. hXh/7Af& 
[0039] 

[^1] H_new(j)=mi n {H_l(j). H_2 
(j). H_k(j)} 
{tztiLO^j&m) Xmh^tli, . 
[0040]ll3«i. iaS^(a),(b)(w^$ilSJ:a(:K 
m-h2r>(r)zru^y9 (7'D>yi?A.B) ic:«lE-ri>t 

OT'n -y A , B ra<7)h X h /7 AfSrSW*«tfm$ tl§ 
0*-S:llJPfU^t><7)T'fcS. as^Wtiyo-y^A.BS 
<7)txh^^7Aiiaa5rS^LTV>5. t^r****. WM, 
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